Channel Coding in the Presence of Side Information

In this paper we review concepts and methods of communication systems equipped with side information. We focus on the channel coding problem, where side information is available to the transmitter in either a causal or non-causal manner, and we also consider the source coding problem with side information at the receiver. We first summarize the main results for channels with causal/noncausal side information and the associated capacity formulas. Next, we consider specific channel models, such as Costa’s dirty-paper model, the AWGN channel model with fading and the modulo additive noise channel. Further, we provide applications to the models considered here, in particular, we present the watermarking problem and the Gaussian MIMO broadcast channel. We also consider algorithms for the calculation of the channel’s capacity, and practical coding schemes for the communication systems explored in this paper. Finally, we study several related information-theoretic problems and present both the WynerZiv and the Slepian-Wolf problems. The source coding problems and the channel coding problems, are presented in a unified version and the duality between the problems is presented. We also present extensions for the MAC and broadcast channel models, to the case where they are controlled by a state process, and consider several hybrid models, e.g., joint source-channel coding for the Wyner-Ziv source and the Gel’fandPinsker channel, and the achievable tradeoff between message and state information rates.